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ON  DIFFERENTIAL  QANSS  VITU  INTEORAL  PAYOFF 

L.  D.  Barkovitt 
W.  H.  Flaains 


1 .  INTRODUCTION 

This  paper  treats  a  certain  claaa  of  two-peraon  aer^-aua 
gainea  which  may  be  described  intuitively  as  followa.  Each  player 
chooaea  a  set  of  Inetructiona  for  play  which  are  called  strategies 
and  which  tell  him  how  to  choose  a  number  from  the  unit  interval 
at  each  instant  of  time  t  lying  in  an  interval  0  ^  t  ^  T.  If 
y(t)  denotes  the  number  chosen  by  Player  I  at  time  t  and  z(t) 
the  number  chosen  by  Player  II,  then  the  position  or  state  of  the 
game  is  determined  by  the  differential  equation 

together  with  the  initial  position  x(0)  •  c.  Ttie  strategit-a  or 
instructions  for  play  may  take  into  account  the  state  x(t)  of 
the  game  at  time  t,  it  being  assumed  that  each  player  always 
knows  the  state  of  the  game.  TTui  payoff  to  Player  I  is  given 
by  the  integral 

T 

P  •  f  f[x(t),y(t),z(t)]dt. 

o 

Player  I's  objective  is  to  choose  a  strategy  which  enables  him 
to  maximize  P,  while  the  second  player's  goal  is  a  strategy  which 
will  minimize  P. 

To  give  a  precise,  useful  mathematical  formulation  of  the 
problem  is  a  nontrivial  tasK,  and  the  present  paper  by  no  means 
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atteapts  to  give  a  complete  theoiry.  There  la  not  even  an  exist— 
ence  theorem  ensuring  that  max  min  •  ein  max.  Sosm  of  the  results 

ehioh  W9  ehall  present  were  first  eUMnei  l|r  tSMM  [$)•  (t)#  ^ 

-  -  -  ^ ^ 

in  a  formal  manner  or  else  under  more  restrictive  conditions 
than  those  set  forth  here.  The  reader  will  also  note  a  connec¬ 
tion  with  the  work  of  Bellman  [l]  .  Mhat  we  do  is  to  consider 
the  problem  as  a  two— elded  extremum  problem  with  differential 
and  inequality  side  conditions  and  apply  well-known  techniques 
of  the  calculus  of  variations  (c.f.  Bliss  [5] »  Valentine  [8]) 
to  see  how  much  Information  can  be  obtained  in  this  way.  Ana¬ 
logues  of  the  classical  Buler  equations  are  derived  as  necessary 
conditions  for  a  saddle-point.  Their  solutions,  which  are  called 
extremals,  turn  out  to  be  characteristics  of  s  certain  partial 
differential  equation  involving  the  value  of  the  game.  The  con¬ 
verse  problem  is  then  treated.  N<amely,  when  does  a  family  of 
extremals  determine  a  solution  of  the  game?  The  basic  condition 
for  thia  is  that  the  curves  x(t)  associated  with  the  family  F 
of  extremals  simply  cover  a  certain  region  R  in  (x,t)  plane. 

The  family  then  defines  a  pair  of  strategies  idiich  are  optimal 
in  a  sense  to  be  made  precise  below.  The  value  W  of  the  game 
ie  a  continuously  differentiable  function  of  position  (c,t)  in 
R.  Actually,  we  consider  the  more  general  cass  of  a  finite 
number  of  nonoverlapping  regions  Rt,...»Rg|f  such  that,  for  each 
i,  R^  ia  simply  covered  by  a  family  of  extremals.  In  this 
case  the  value  W  Is  continuously  differentiable  in  each  region 
R^  and  is  continuous  across  boundary  arcs  common  to  more  than 
one  region.  The  partial  derivatives  of  W  are  in  general 
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diteontinuous  across  such  boundary  arcs. 

Althou^  the  discussion  in  this  paper  is  carried  out  for 
a  scalar  differential  equation,  1  *  g*  the  arguisent  can  be 
carried  over  to  a  vector  equation  X  •  0. 
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2.  WATHSMATICAL  FORMULATION 

We  begin  by  defining  certain  tenaa  which  are  uaed  through¬ 
out  thia  paper.  An  arc  in  the  (x^t)  plane  la  called  aaooth 
if  each  function  in  its  repreaentatlon  In  terva  of  arc  length 
ia  twice  continuoualy  differentiable.  A  region  0  in  the  (x,t) 
plane  haa  a  piecewiae  amooth  Boundary  if  ita  boundary  eonaiata 
of  a  finite  number  of  aaooth  area  without  cuapa  at  comera .  Let 

9  denote  the  cloture  of  0.  A  function  4(x,t)  ia  in  V  if 

( k ) 

it  ib  C'  ^  in  0  and  all  of  ita  derivativea  up  to  and  including 
thoae  of  order  k  have  a  continuoua  extenaion  to  0. 

Throughout  this  paper  we  ahall  be  conaidering  two  real- 
valued  functiona  f(x,yfZ)  and  g(x,y,E)  which  are  defined  for  all 
X  and  for  all  y,i  with  0^y<l,  O^t^l,  and  which  aatiafy 
the  following  conditionas 


(a) 

f  and  g  are  on  the 

cloaure  of  their  doa^in 

of  definition; 

(b) 

<0, 

2  0. 

Syy  •  0, 

g„  -  Oj 

(c) 

ax  >  b  ^  g(x,y,z)  ^  a'x 

b*  for  Buitable  conatajSta 

a,a ' ,  b,b '  . 

Let  T  >  0  be  fixed  for  the  remainder  of  thia  paper.  The 
aynbol  R  will  deaignate  a  region  of  the  (x,t)  plane  contained  in 
the  atrip  0  <  t  <  T,  auch  that  the  projection  of  R  on  the  t  axia 
covera  the  entire  interval  0  <  t  <  T.  We  ahall  oonaider  functiona 
y(x,t)  and  t{x,t)  defined  on  R  and  the  differential  equablon 

(2.2)  *  -  ^  -  g[«.y(x.t),l(x,t)] 
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wlth  initial  condition 

(2.^)  -  c,  0  ^  <  T  and  (c,!^)  In  R  , 

at  rollovfs  .  Let  denote  a  class  of  fwinotlons  y{x,t),  and 

^  a  class  of  functions  s(x,t),  defined  In  R,  such  that  for 

r 

each  y  In  v^.  and  z  In  ^  the  following  properties  holdi 

(a)  0  ^  y(x,t)  ^1,  0  <  z(x,t)  ^  1. 

(b)  There  exists  a  decomposition  (which  may  depend 

on  the  pair  (y,z))  of  the  region  R  Into  non- 
overlapping^  subregions  with  piecewise 

(2.4)  smooth  voundixrles  such  that,  In  each  open  region 

Rj ,  y  and  z  coincide  with  functions  that  are 
In  R^. 

(c)  For  each  (c,tQ)  belonging  to  R,  the  equation  (2.2) 
subject  to  (2.^)  has  a  finite  number  g(  2  ^ 
solutions  xt(t),...,x^  (t),  each  satisfying  a 
Llpschltz  condition  and  lying  In  R  for  <  t  <  T. 
Furthennore ,  with  the  possible  exception  of  finitely 
many  values  of  t,  tne  point  (Xj(t),t),  J  ■  1,...,  o<  , 
belongs  to  Just  one  region  R^ . 

(d)  If  (c^t^)  belongs  to  Jast  one  region  R^,  then 
C*'  -  1  . 

The  accompanying  figure  may  help  indicate  what  we  have  In 
mind.  In  this  case  R  •  Riv'H*v^R*.  The  dotted  lines  Indicate 
the  curves  x(t)  resulting  from  (2.2). 

‘  Ebr  nonoverlapping  subregions  we  mean,  as  usual,  subregions 
such  that  no  two  have  a  common  Interior  point . 


iMcpt  for  (o«t^)  on  Um  townAniy  aiy%.^  %*  m 

path  is  unique.  On  the  boundary  thore  are  toro  cunroOf  ono 
entering  Rt  or  Ra  and  the  other  entering  R^. 

At  this  point  it  should  be  noted  that  if  (o»t^)  is  in  an 

(2) 

open  region  then  the  assumptiona  that  g  is  in  C'  *  and  that 
y  and  z  are  in  on  R^,  coupled  with  the  standard  oxistenoe 

and  uniqueness  theorem  for  ordinary  dirferential  equations, 
guarantee  that  there  is  a  unique  solution  through  (c,t^).  Froa 
the  fact  that  is  not  less  than  1  and  is  finite,  and  froa  the 
uniqueness  of  the  solution  of  (2.2)  —  (2.3)  in  R^,  it  follows 
that  on  each  the  solution  of  (2.2)  -  (2.3)  is  unique.  This 
uniqueness  and  the  assumption  that  each  solution  meets  the  sets 
^i ^  Rj  in  at  most  finitely  many  points  haetjas  a  oomsq— s#  tiM 
fact  that  at  each  point  of  R  the  Index  d  cannot  exceed  the  num¬ 
ber  of  regions  R^  meeting  at  that  point . 
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■trmt>£lo» . 

There  is  a  certain  element  of  artificiality  in  this  definition 
in  that  a  strategy  y  in  V  may  no  longer  be  a  strategy  if  ^  ia 

V 

replaced  by  a  different  class  'y  of  functions  E(c,t).  In  order 
to  get  a  satisfactory  general  notion  of  strategy  for  games  of 
this  type,  it  may  be  necessary  to  resort  to  notions  similar  to 
that  of  K-strategy,  in  the  terminology  of  Isaacs  [6]  .  It  is 
proved  in  [oj  and  also  in  [3]  that  if  the  value  W  of  the  game, 
a  notion  to  be  defined  precisely  below,  is  a  continuously  dif¬ 
ferentiable  function  of  position  (x,t),  then  ^-effective  K— 
strategies  exist.  It  would  be  interesting  to  extend  this  result 
to  the  present  case  in  which  W  will  turn  out  to  be  only  piecewise 
continuously  differentiable. 

Let  yt^y.*  wwl  let  (c,t^)  be  a  point  of  R  belonging 

to  Just  one  subregion  Let 

(2.5)  y(t)  -  y[x(t),t]  ,  z(t)  -  i[x(t),t], 

where  x(t)  is  the  solution  of  (2.2)  -  (2.3).  The  functions 
x(^)*  y(i)»  >(^)  determined  by  (2.2),  (2.3)  and  (2.5)  will  be 
called  the  path  corresponding  to  the  pair  of  strategies  (y,E). 

Define  the  payoff  as  follows: 

T 

(2.6)  P(y,z;c,t  )  -  /  f [x(t),y(t),i(t)]dt. 

*0 

P  is  to  be  thought  of  as  the  payoff  to  Player  I,  and  -P  the 
payoff  to  Player  II.  If  (c,t^)  belongs  to  more  than  one  region 
R^,  there  are,  in  general,  finitely  many  solutions  X|  (t ) , . . .  ,x^  (t ) 
of  (2.2)  through  (c,t^).  Let  j  (y#*ic  ,t^)  denote  the  payoff 
when  the  solution  x^  (t),  aT  •  1  * . . . >  x  f  is  used. 


We  shall  sometimes  call  the  elements  y,z  of 


1 
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A  pair  of  functions  (y*fX*)  with  x*€  ^  is  ssid 

to  b«  a  sttddls— point  rslative  to 

(a)  ^(/^ )  (y*»****®  i*.»*  oC. 

Call  this  valus  W(c«t^). 

(2.7)  (b)  For  all  'nt  Xit  ^  •  all  indices  M  vUleh  Mgr  arlss 

» 

from  the  pairs  (y«i*)  at  and  all  Indicts 

j  which  may  arist  from  the  pairs  (j*fS)  at 
we  have 

i  w(c.to)  i  . 

Henceforth  a  path  correapondin^  a  aaddlt— point  (y®(a>t)»  s*(x«t)) 
will  be  denoted  by  x(tf),  y(t),  E(t).  Also,  whtnsvsr  <<•  1  wt 
shall  drop  the  subscript  on  the  payoff  P, 

We  close  this  section  with  some  remarks  about  the  assvmip- 
tions  on  f  and  g.  Conditions  2.1(b)  say  that  f  is  oonoavs  in  y 
and  convex  in  z ,  and  are  imposed  in  order  to  avoid  introdueint 
mixed  strategies .  In  similar  problems  involving  only  maxisdia- 
tlon  or  only  minimization,  such  concavity  or  convexity  require- 
menta  were  found  to  be  essential  to  ensure  that  the  maximum  or 
mlnimua  is  attained.  (See  [2].)  The  requirement  (2.1) (c)  is 
placed  on  g  to  ensure  that  the  solutions  of  (2.2)  and  (2.3)  have 
a  uniform  bound  depending  only  on  the  initial  condition  (c»tQ)« 


!> .  WgCaSSARY  CQNDITIOMS 
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We  now  proceed  to  derive  a  set  of  neceeeary  conditione 
which  Bust  hold  along  a  path  resulting  from  a  saddle— point . 

In  simple  examples,  use  of  these  necessary  conditions,  together 
with  the  sufficiency  theory  to  follow  in  Sections  4  and  5»  often 
enables  one  to  find  the  complete  solution  to  the  game.  (See 
Section  7.) 

Let  (y*(x,t),  z*(x,t))  be  a  saddle-point  relative  to  (/^, 
y)  and  (c,0),  where  (c,0)  belongs  to  Just  one  region  and 
let  it  be  assumed  that: 

Por  0  <  t  <  T  the  curve  x(t)  lies  in  the  open 
region  R,  the  regions  R|,...,Ry^  are  numbered  so  that 
the  curve  x(t)  has  a  nonnull  intersection  with  the 
(3.1)  first  k-fl  £  n  regions  and  meets  x(t) 

for  t  -  t^,  0  <  tx  <  ...  <  tj^  <  T.  Furthermore, 
each  sufficiently  small  neighborhood  of  (x(tjj^),t^) 
intersects  •  smooth  arc  ^^(t)  which  is 

not  tangent  to  x(t)  at  t  •  t^. 

Since  g  is  of  class  and  y*  and  t*  are  on  each 

it  follows  from  the  standard  exlatence  and  uniqueness  theorem 
for  ordinary  differential  equations  that  the  equation 

^  -  8[x,y»(x,t) ,z*(x,t)]  , 

subject  to  the  initial  condition  x(t^)  •  x^,  has  a  unique  solution 
x(t;XQ,t^)  thro'igh  each  point  ^  ■  !*•••#  n.  The 

nontangenoy  condition  in  (3.1)  ensures  that  for  (*q*^q)  sufficiently 
close  to  (Jt^.t^)  the  solution  x(t;x^,t^)  has  a  unique  cootlnuatlon 
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across  each  arc  i  ■  Thia  fact  together  vlth 

(2.1 ) (c)  implies  ths  existtncs  of  a  constant  K  such  that  for 

(X(^,t^)  sufficiently  close  to  Inequality 

holds  foi  ^  ^  £  T. 

T^e  case  in  which  x(t)  follows  some  boundary  over 

an  interval  uf  tine  rather  than  crossing  as  in  (3.1)  is  also 
of  importance,  but  is  not  treated  here. 

Let  us  introduce  the  following  quantities,  which  play  a 
fundamental  role  in  what  follows: 

H(t)  -  fy[*(t),y(t),i(t)]  ^  A(t)gy[x(t),y(t),¥(t)], 

(3.2) 

K(t)  -  f  jCx(t),y(t),z(t)]  -►  A(t)gj^[i(t),y(t),i(t)]  , 
where  A(t)  is  a  multiplier  determined  by 
{i-y  '.(t)  -  -rj^[x(t),y(t),?(t)]  -Agjj[i{t),7(t).*(t)]  . 

\(T)  -  0. 

Theorem  1 .  Let  (y*(x,t),  3«(x,t))  be  a  saddle-yoint 
relative  to  ^  for  the  initial  condition  (c,0),  and  let  (3.1) 
hold .  Then  for  t  |  tj^,  1  •  1,2,  the  following  neoessary 

condition  is  satisfied; 

H(t)  >  0  whenever  y(t)  •  1,  K(t)  ^  0  whenever  s(t)  •  1 

(3.^)  -0  whenever  0<y(t)<l,  -0  whenever  0<t(t)<l, 

<  0  i^enever  y(t)  *0;  £  0  whenever  2(t)  •  0. 
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We  note  that  Theopcra  1  la  the  exact  analogue  of  the  cor¬ 
responding  necessary  condition  for  maximuji  problems  [2,  formula 
(4.2)].  In  the  latter  case,  however,  it  is  not  necessary  to  mM.hm 
any  restrictive  assumptions  such  as  (3*1  )• 

TYie  proof  of  Tlieorem  1  la  begun  by  following  the  coouaon 
variational  technique  of  finding 

(^.3)  lim  }  [P(y*>t  >1  ,z*)  -  P(y*,z*)]  , 

/->0  ^ 

where  £^(x,t)  is  an  "admlaalble  variation"  for  small  t>  0. 
Specifically,  let  >^(x,t)  be  in  R,  vanish  Identically  out¬ 

side  of  one  of  the  subregions  R^^,  and  satisfy  0  <  y*  •♦'►]<  1 . 

Let  x^  denote  the  solution  of 

i  -  «[x,y*>  £yi,z*]  ,  x(0)  -  c. 

From  the  assumptions  concerning  y|(x,t)  and  the  discussion 
iDsnedlately  after  (3.1)  It  Is  not  difficult  to  see  that  there 
Is  a  constant  K  such  that  for  0  ^  t  ^  T  we  have 

|Xj(t)  -  i(t)|  <  Kf  . 

For  brevity  let  us  write 

*  -  ■'■x  *  Vi  *  ' 

®  •  *x  *  Vi  *  ■ 

Define  ^(t)  by  the  equations 

BV  8y>(  .  ^(0)  -  0. 
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Ety  standard  arguments  [2]  the  limit  (>o)  exists  and  equals 
T 

/  (Af  >  f/l)dt  . 

o  ^ 

Define  A  j ( t )  by 

A,(t)  -  ^x(T)  -  0. 

Integration  by  parts  gives  [2,  Section  4] 

T  T 

/  (A‘>fy>;)dt  -  /  (fy^Xigy)  ndt. 

Since  (y*,t*)  Is  a  saddle— point , 

-  P(y*,z»)  ^  0 

for  sufficiently  small  t  .  Hence 
T 

y"  (fy  +  ^'igyjndt  <  0 

for  ali  It  followa  that  alnce  ^  la  arbitrary, 

r 

'  2  0  Waenever  y  -  1 , 

(^.6)  iy  +  '^iSy  i  “  0  whenever  0  <  y  <  1, 

I  £  0  whenever  y  •  0, 

provided  t  +  tj^.  A  similar  argument  shows  that 

<  0  whenever  z  ■  I, 

(d.7)  f^  ®  whenever  0  <  f  <  1, 

'  >  0  whenever  2  ■  0, 

provided  t  ^  t^^.  However, 


(^.8) 


A  > 
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Fro®  (3.^),  (3*7),  and  the  fact  that  for  ^  f  Fj  ®^hd  z*  vanish 

whsnever  y*  •  0,  1  and  z*  -  0,  1,  respectively,  It  follows  that 
along  the  path  x(t),  y(t),  z(t),  the  third  and  fourth  tenna  of 
(3.8)  vanish.  Hence 

Since  this  is  just  the  defining  equation  for  ^(t),  it  follows 
that  ‘i(t)  ■  ^(t),  and  the  theorem  Is  proved. 


4  .  AN  INVAHIANT  INTSQRAL 
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This  section  and  the  two  succetding  sections  will  be  devoted 
to  developing  sufficient  conditions  for  the  existence  of  a  saddle— 
point.  Let  us  call  any  solution  x(t ) ,y (t ) ,z(t )  of  the  necessary 
conditions  of  l^eorem  1,  where  x,  y,  z  are  further  related  by 
^  •  8(^»yiz),  x(0)  -  c,  and  extremal  through  the  initial  condition 
(c,0).  For  a  maxlsilzat ion  problem  (i.e.,  z  absent)  the  solution 
may  be  given  In  terms  of  functions  of  time  only  and  is  an  sxtreeal , 
although  not  every  extremal  need  maximize  (c.f.  [2],  [*>])•  For 
the  game,  however,  examples  show  (see  Section  7)  that  the  solution 
cannot  be  found,  In  general,  in  terms  of  functlona  of  time  only. 
Hence  to  construct  saddle-points  it  la  at  once  necessary  to  con¬ 
sider  families  of  extremals  through  a  variety  of  initial  con¬ 
ditions.  The  problem  before  us  Is  to  determine  when  a  ono- 
parameter  family  of  extremals  actually  yields  a  saddle— point . 

fie  begin  by  defining  an  analogure  of  the  Hilbert  invariant 
Integral  of  the  calculus  of  variations.  In  addition  to  the  oon- 
dltlons  impo  sed  on  R  in  Section  2,  let  R  be  simply  connected  and 
have  a  flecewlse  smooth  boundary,  and  let  y*(x,t),  z* (x , t ) ,4(x, t ) 
be  three  functions  which  satisfy  the  following  conditions: 

(a)  0  ^  y*(x,t)  <1,  0  ^  £  1; 

(b)  y»,2*,  '  are  ^  in  R; 

(4.1)  (c)  for  all  (c,t)  in  R  the  game  over  the  square 

0<y<l,  0  <  z  ^  1 ,  with  payoff 


t(x.t;y,z)  -  r(x,y,z)  ♦  a(x, t )g(x,y,z) 
has  (y*ft*)  as  saddle-point  1  ana 
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(i)  A_^(x,t)g(x,y«,2*)  ♦  A^(x,t) 


An  Imraodlate  consequence  of  (4.l)(c)  le  the  foliowixigt 


(4.2)  ^«^y)  • 

where  the  derlvallvee  of  f  and  g  are  evaluated  at  (x,y*,z*). 
Let 

(x.t)  -  f(x,y»,2*)  ♦  '(x,t)g(x,y*,r») . 

T^en 

+x  ■  f''**  *  yjtv  *  ‘if'’**  *  v- 


Prom  (4.2)  and  (4.l)(d)  we  got 
(*.})  tx  -  “"x  *  'Sx  ♦  ''■x« 


t 


Define 

(4.4)  W(x,t)-  \J^dt-'dx,  (x,t)lnR  , 

(x.l) 

«li«re  the  upper  XlAlt  le  a  ftxad  but  arbitrary  point  in  V  ani 

the  Integral  la  taken  over  an  arbltrarj'  path  which,  perhaps 
excluding  end  points,  Ilea  In  R.  In  view  of  (4.5)  It  Is  clear 
that  (4.4)  Is  Independent  uf  path,  and  so  W(x,t)  Is  well  defined 
In  R.  Clearly, 

(♦.b)  “t  *  “  <'>  “x  ■ 

The  following  lemma  Is  an  laoiedlate  consequence  of  the  preceding 
discussion  . 

Lemma  1  .  Por  all  (x ,  t )  ^  J{,  and  0^y<l,  O^z^l,  we  have 


(4.6) 


i'(*.y  ,2*)'^W^g(x,y  ,r*) 
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5 .  FIELDS 


The  notion  of  a  field,  which  la  taken  from  tha  calculus  o/ 
varlatlona,  will  now  be  Introduced.  Let  R  be  a  region  with 
plecewlae  smooth  boundary  contained  In  the  atrip  0  <  t  <  T  of 
the  (x,t)  plane  as  described  In  Section  2,  and  such  that: 

(a)  There  la  a  decomposition  of  R  Into  a  finite 

nuaiber  of  nonovcrlapplng  reglona  Rj ,  such 
that  R  -  .  . . .  V  and  such  that  each 

R.i  J  -  l,...,n,  la  simply  connected,  ha a 

V 

(t.  1)  plecewlae  aaooth  boundary,  and  has  functions 

y«(x,t),  t|(x,t),  'i  (x,t)  defined  on  It  which 

j  J 

satisfy  conditions  (4.1). 

(b)  There  arc  functions  y*(x»t),  t*(x,t)  which 
satisfy  (2.4)(a),  (2.4)(c),  (2.4)(d),  and  agree 

{x,t),  respectively,  for  (x,t)tRj. 
Purthermure,  suppose  that  there  Is  a  function  W(x,t) 
deflried  In  R  such  that 


wltn 


t).rj 


(5.2) 


(a)  W  Is  continuous  In  R  and  C 

(b)  W(x,T)  -  0; 


^  ^  ^  In  each  Rj  ,  J  •  1 , . . . , 


(c)  for  (x,t)  In  Hy  W  satisfies 


2-(x,t)  -  /l.  (x,t), 

A  ^ 

W^(x.t)  -  -  4'i(^»t)  -  -  (f(x,yj,ij)  >  '\jg(*.y],*j)) 

A  region  R  satisfying  (‘o.l)  and  a  function  W  satisfying  (3.2)  are 
said  to  constitute  a  field  P. 


The  Justification  for  the  notion  of  a  field  la  to  be  found 


In  the  following  discussion.  Associated  with  a  field  P  are 
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functlont  y*  and  t*.  There  exist  nonoapty  faalllea  of  functions 
I/- and  ^  which  eatlefy  (2.4)  and  contain  y»  and  x*.  reepactlvely , 
For  example,  ^  can  be  taken  to  bo  the  set  of  all  y(x,t)  which 
t,  In  Rj  and  coincide  with  y*(x,t)  In  a  neighborhood  of 

the  boundary  of  R,  for  each  J  •  The  class  i  can  be 

^  •  L 

defined  similarly.  We  emphasize  that  this  particular  pair  Is 
offered  only  as  an  example;  In  what  follows  «md  ^  are  arbi¬ 
trary,  subject  only  to  (2.4)  and  the  condition 

Theorem  2.  Let  F  be  a  field  and  let  the  notation  be  as  In 
(5.1)  and  (b  .2 )  .  Then,  for  any  {^qp^q)  Ali  r  of  func- 

tlons  y*(x,t),  z*(x,t)  Is  a  saddle-point  relative  to  v- . 

J  S' 

for  the  Initial  conditions  >  sJ^d  w(x^,t^)  Is  the  value 

of  the  game. 

Proof .  Any  solution  x^lt)  of 


^  -  glx,y(x,t),z*(*.t)|  , 

with  associated  y^{t)  -  y*(x^(t),t),  z^{t)  -  z»(x^(t),t).  Is  an 
extremal,  by  ,  1).  Along  the  extremal. 


dw(x^(t)  ,t) 

- h - •  ’«-<'■*  '-8)  *  -nx^{t),y^(t),z^(t)), 

except  for  a  finite  exceptional  set  S  of  values  of  t.  At  the 
exceptional  points,  however,  both  right-  and  left-hand  derivatives 
Since  W  Is  continuous  we  may  write 


W(x  , 

'  o 


t  ) 

r\  ' 


,  -dW  N 

.Try 


dt  - 


r(*o(t) 


exist . 


F-n7 

8-10^ 

and  so 

for  any  K  and  In  H.  Let  y  be  ein  eleaent  of  ^  ,  and 

let  Xi(t),  yi(t),  Zt(^)  denote  any  path  oorresponding  to  the 
strategies  y(x,t),  z«(x,t).  Along  this  path 

^  ■  Wjjg(xi  ,y 

except  for  a  finite  number  of  exceptional  points  which  constitute 
a  set  El .  Using  (4.6),  we  obtain  for  all  t  not  lying  in  B| 

^<  —  ^*(xi,yi,ii)  . 

At  tne  exceptional  points  both  right-  and  left-hand  Ilaita  of 

dw/dt  as  well  as  f(xi,yi,Zi)  exist,  so  properly  interpreted  the 

inequality  holds  along  the  entire  path.  It  follows  that 

T 

^  ^  f(xi  ,y,  ,2|  )dt, 

^o 

and  sc 

for  all  indices  and  functions  y  in  ^  .  A  similar  argument 

e' 

can  be  usea  to  show  that 

for  ani'  z  in  ^  and  index  -  .  The  theorea  is  thus  proved. 


6.  SUmCISMT  CONDITIOHS  FOR  A  FIKLD 
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In  thl*  section  we  proceed  to  find  conditions  under  which 
A  family  of  extremals  defines  a  field.  The  most  essentisl  fea¬ 
ture  which  the  family  should  possess  Is  that,  with  the  exception 
of  certain  boundary  points,  eacn  of  the  region  covex*ed 

has  a  uniquely  determined  extremal  of  the  family  passing  throu^ 
it . 

We  may  then  define  y*,z*,  and  ^  at  agree  with 

the  y,r,  and  A  ,  respectively,  associated  with  the  extremal. 

A  precise  formulation  of  this  intuitive  Idea  is  given  in  Theorem 
3.  Since  it  is  not  possible  in  general  to  obtain  the  solution 
with  a  single  family  of  extremals,  the  Idea  expressed  above  is 
generalited  to  include  m  families  of  extremals,  each  simply 
covering  a  region  R^,  1  -  l,...,a. 

Theorem  3»  Let  R  be  a  region  with  piecewise  ssKX)th  boundary, 
and  let  there  be  a  decomposition  of  R  into  nonoverlapping  aub— 
regions  1  •  !»•••»».  such  that  R  •  V  ...  V  For 

each  i ,  1  - 

1.  Let  denote  the  closed  re^ition  of  the  (t.u) 

plane  bounded  the  curves  u  •  u^^ ,  u  ■  uj 

(•►  aD>uJ  >u^  >-00),  t  -  T,  and  t  -  t  (u) , 

(2 ) 

where  tj^(u)  is  defined  and  is  piecewise  ' 
without  cusps  at  corners  on  the  interval  u  <  uj, 

and  where  tj^(u)  T,  with  equality  permitted  only 
for  u  •  uj  or  u  •  u^ .  Furthenaore ,  let  tnere  exist 
fa;ally  of  curves  k  ■  0,1, 


d 


•  •  • 


,k(1),  defined 
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and  plectwiit  C'  '  without  cuap»  at  cornre 
on  tha  inf  rval  <  u  <  uj,  tuch  that 

—  **’  —  ^ 

for  all  <  uj,  with  toualitiaa  paralttad 

only  for  u  •  uj  or  u  ■  u^.  Danota  by  tha 


nonovarla 


aubraffiona  dafinad  by  tha  eurvaa 


t.^^(u),  the  indax  k  of  tha  raKion  ba 


mant  with  tha  indax  of  the  rijght-hand  bound 


curve . 


Let  there  axlat  a  ona-caraMter  family  of  axtraa^a 


x^(t,u),  yj^(t,u),  2j^(t,u)  with  aaaoclatad  functlona 
^^(t,u)  Buch  that : 


(a)  x*(t,u)  ia  continuoua  on  U«  and  aapa  0 


(b)  For  each  k,  x^(t,u)  cq Inc idea 
Id  y^(t,u),  t^(t,u) 


functiona  C 


In 


(c)  |xJ^(t,u)|  >  d  >0^0^,  MtMr«  d  .^LJB 
appropriate  conatant . 

(d )  The  functiona 

H^(i»u)  •  fy *y^ ^ ^ »'^)8y »y^ * *^ ) » 
R^(t,u)  - 

**^era  x^  -  Xj^(t,u),  y^  .  yj(t,u),  x^  -  x^(t,u), 
are  both  continuoua  on  0^^;  aoraovar,  vanlthaa 
at  any  point  where  id  dia continuoua.  and 
vaniahea  at  any  point  whara  b«  ia  d ia continuoua . 
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.  Let  the  functiona  Wj^(t,u),  defined  Jz 

T 

(d.I)  w^(t,u)  •  J  f  ( t ,  u )  ,y  ^  ( t ,  u ) ,  t  ( t  ,u )]  d  t ,  1*1, .. 

be  such  that  whenever  Xj^(t,u)  ■  Xj(t/a*)  then 

Wj(t.u)  .  Wj(t,U'). 

Ttien  the  *t.  fainlllea  Xj  (t,u),  .  .  .,Xjjj(t,u)  determine  a  field  P 
over  R. 

Pi'oof .  It  l8  required  to  show  that  (d.I)  and  (5.2)  hold. 

Prom  hy^jotheses  1  and  2  It  can  easily  be  shown  that  correapond— 

Ing  to  each  there  la  deteniilned  by  means  of  Xj^(t,u)  a  simply 
connected  region  with  piecewise  smooth  boundary  and  such 
that  for,  i,k  4  J ,  regions  suit¬ 

ably  renumbered,  can  be  taken  as  the  subregions  Rj  of  R  described 
in  (5,1)  (a).  It  also  follows  from  the  hypotheses  of  the  theorem 
that  for  each  1  the  functions  Xj^(t,u)  can  be  Inverted  to  give 
functions  u  -  aj^(x,t),  continuous  on  and  In  each  • 

For  (x,t)  In  R^^^  define: 

yj^(x»t)  -  yj^(t  ,Uj^(x,t)), 

(0.2)  ,Uj^(x,t)), 

Aj^(^*t)  “  ^  ( t ,  Uj^  ( X ,  t ) ) . 

These  fujictlona  clearly  satisfy  (4.1  )(a)  and  (4.l)(b)  on  ^Ik  • 

Since  x^(t,u),  yj^(t,u),  z^(t,u)  Is  an  extremal,  and,  by  (2,l)(b), 
f  \  &  Is  concave  In  y  and  convex  In  r.  It  follows  that  (4.i)(c) 
aloo  holds  on  R^^*  Prom  tne  definition  {!>•!>)  of  and  the 
relation 


»■ » 


^It  ■  *lt  *  ^'iKt 


-  \kx  8(*i-yi**i) 


'ixx  *  \kt 


It  follows  that  (4.i)(d)  holds.  Hence  (5.1)(e)  la  verified. 

To  show  that  (t).l)(b)  holds,  we  proceed  as  follows.  Define 

y(x,t)  - 

z*(x,t)  -  zj^(x,t)  for  1  -  k  •  l,...,k(l), 

If  (x,t)  belongs  to  J 08 1  0 ne  re g 1 o n  ^ If  belo ng s  to 

more  than  one  region  then  we  choose  the  first  such  region 
accoralng  to  the  lexicographic  ordering  of  (l,k)  to  define  y* 
and  z* .  With  this  definition,  y*  and  z*  satisfy  (2.4)(a).  For 
the  ^ur^ose  of  checking  that  (2.4)  (c)  and  (d)  hold.  It  suffices 
to  show  that  for  any  1,k,u,  the  curve  Xj^(t,u)  Is  not  tangent  to 
the  curve  X(u)  -  x^  ( tj^^ (u)  ,u) .  TY^ls  Is  Inunedlate,  for  tangency 
at  a  point  would  Imply  the  exlstenee  of  a  constant  ^  such  that 

dtik  -  /dt, 

whence 

X,  du  -  0. 
lu 

But  du  I  0  since  1®  and  Is  bounded  away  fro« 

zero;  thus  the  curves  cannot  be  tangent. 

We  now  proceed  tu  verify  {o .2)  .  Define 

(b.3)  ■i^(x,t)  -  w^(t,Uj^(x,t) )  for  (x,t)t  7^^  . 

Prom  hypothesis  )  It  la  clear  that  W(x,t)  Is  contlnuoua  on  R 
and  la  on  each  •  It  Is  evident  from  (6.1)  and  (6.^) 

that  W{x,T)  -  0.  Thus  (5.2)(8)  and  (j.2)(b)  are  eatabllahed. 

On  eacn  we  have,  by  (6.^), 

W(x(t,u),t)  -  w^(t,u),  u  -  Uj^(x,t)  , 


whence 
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X. 

X  t 


h  • 


It 


,  by  (b.l),  Wj^^  •  -f  and  -  g,  oo  we  have 

-  -r(x,y*,z*)  -W^(x,t  )g(x,y«,z«)  . 

"niuB  to  establish  (5.2)  (c)  It  la  required  tc  show  that 

on  each  T^iat  Is  to  say  (see  (o.2)).  It  suffices  to  show 

that 


(b.A)  ,\^(t.u)  -  ^^(t,u^(x,t))  -  . 

Dlf I'ercnt latlng  (b.l)  yields 


(t)o) 

where 


hu  -  "  I 

t  t,  >t 


dt 


Ik 

3^ 


^•fx.  ■♦■fy.  -ffz.  , 

2u  X  lu  y’^lu  z  lu  ' 

the  •♦■  und  -  superscripts  Indicating  right—  and  left-hano  limits 
as  (t,u)  — >  (tj^^(u),u)  from  the  Interior  of  Uj^  and 
respectively.  Upon  differentiating  the  right-hand  side  of  (d.4) 
with  respect  to  t,  we  get,  with  the  help  of  (6.b), 


<"iuhx)t  ■  -  5x;  hx  *  hu  hxf  ” 


Ik 


'^Ix  "  ^ 


,  r 


—  u,  •  f  +  f  y,  -f  f  z,  a, 
du  lx  X  y’^lu  zlulx 


X 


Hence,  by  (b.2). 
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(0.0)  ^ 


>1-  u  f  ,  -  ,  r  -  >f 

3ulx  X  ydx  z^x  ^x 


Furtnernicre  , 


rfhero 


'^lu  ^Ixt 


iu  lut 


«■«)(*)  ■ 


Ju  "  *^x*lu  lu  ^lu 


Thu*,  writing 


^v• 


Ik 


>2 


JX 


«4 


Jk 


Z  )  X 


we  have 


^  -  (“lu^x*  lx  • 


By  ualng  (^.2)  one  can  write  tne  difl erentlal  equation  (^.^) 


or 


aa  followa 


J  f  , 

where  l'/  x  and  'g/’X  are  ae  defined  In  (b.o)  and  (6.7).  Ttius 
lor  eacn  <  u  <  uj,  ^J^(t,u)  and  eatlsfy  the  saiae 

differential  equation  In  t  at  all  Interior  points  of  the  regions 
Furthermore,  since  w^^(T,u)  •  0,  ^j^(T,u)  -  0,  It  follows 
that  to  complete  the  ;.roof  of  (o.4)  it  la  necessary  to  show  tMt 


lu 


Uix  Is  contlnuouB  across  the  curves  IP  **®  drop  the 


subscript  1  ar.d  use  the  superscripts  -f  and  -  as  explained  above, 
then  fur  each  k,  k  -  1 , . . . , k ( 1 )-l  ,  It  Is  required  to  show  that 


(wu)  -  (wu)'*’»0 
'  u  X  ^  '  u  X  ' 
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Now 


(Vx) 


-  (w  U  )■*■ 
'  U  X  ' 


(0.8) 


Clearly,  (b.4)  Is  valid  on  ^  j  J  ®o,  proceeding  Inductively, 
we  may  assume  that  ^  •  1^  follows  from  (oo)  that 

"u  -  “u  "  'I)  -  '■(*.^1.  '1)1  • 

Nrltlng  X  as  the  integral  of  g,  and  then  differentiating  with 
respect  to  u,  gives 

Thus  the  rlcht-hjind  stemNer  of  (6.8)  can  ba  written  aa 


and  to  complete  the  proof  we  must  show  that  the  term  In  curly 
braces  Is  zero. 

If  y'*’  m  y~ ,  z"*”  •  z~ ,  then  there  Is  no  problem.  Suppose  y  | 
but  z  -  z"*^  •  z.  Then  by  hypothesis  2{d),  H  -  I'y  '  &y  -  0.  It 
follows  .^roo  the  concavity  of 

i(y,z)  -  f(x,y,z)  1  >g(x,y,z) 

In  y  that  both  y^  and  y~  maximize  ()  for  the  given  z  and  x  In 
question.  Hence 

f(x,y'^,z)  -  f(x,y~,z)  -  '‘[glx.y*^,  2)  -  g(x,y",r)]  , 
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wnich,  since  z  -  z”  -  ,  sayi  that  the  term  In  curly  braces  is 

zero.  Suppose  then  that  y”  ^  y"*^,  i“  |  z'*’ .  TYien  H  ■  K  •  0,  and 
(y*~,z  )  and  {y^,z^)  are  both  saddle— points  for  the  gajie  over  ths 
square  with  payoff  f{y,z).  Herce  ^(y  wid 

-f(x,y”,z“)  -  ^[g(x,y‘^,t'*’)  -  g(x,y“,x“)]  , 


aa  waa 


to  be  proved. 


7.  AN  EXAMPLE 
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We  ahall  consider  the  sane  for  which 

f(x.y.*)  -  X*.  g(x,y»*)  -  2y  -  J  -  1,  x(0)  -  c. 


Let  ua  make  some  preliminary  obaervationa .  Intuitively, 
it  la  desirable  for  Player  I  to  make  x  either  very  large  or 
very  small  if  possible.  Further,  given  sufficient  time  he  can 
reach  either  of  these  goals,  as  is  shown  by  the  following  table 
which  gives  the  values  of  dx/dt  for  the  extreme  values  of  y 
and  z . 


2-0  2-1 


y  -  1  .1 

This  suggests  that  a  good  choice  for  1  may  be  either 


yQ(x»t)  -  yQ(t)  -  0  or  yi(x,t)  -  yi(t)  -  1. 


Horeover,  if  c  >  0  and  1  chooses  yi,  II  should  clearly  choose 
S|  -  1.  Siaiilarly,  if  c  <  0  and  I  chooses  y^,  II  should  choose 

z  -  0.  ke  have 

o 


(7.1) 


P(yo.^*) 


T  ,_a 

(c-t)«dt  -  c*T  _  cT*  ♦  , 

o 

T 

(c-Vtt)*dt  -  c*T  -  Vs  cT*  ♦•/♦▼•» 


P(yi,Xo) 

Ply  I »zi ) 


T  ^ 

(c-ft)*dt  -  c*T  cT*  ♦  V^» 

6 

T  .  T* 

(c-*.‘/st)*dt  -  c*T  ♦  Vs  cT*  ♦  Via  • 

6 


*  *  -  »  • 


I-  '  •*»►-  ,  **_,% 


.•rw 

t  .' 


Cltarly , 


•  .  '  * 


.<<  V 


p(7o»*o)  >  P(yi#*i) 


<  P(yi,zi) 

» 

MxX,  if  O.s)  Md  (3.?), 


U  T  >  4*. 

ir  t  <  6«. 


'*»  /  • 
>  "V  > 


rv 


H  -  fy  > 


-'■Sy  -  ^^  . 


w 


3T 


■  ‘'l  *  ^8* 


-  (f^  ♦  X 


-  Vt^ 


«x>  •  -  2** 


1.  ■ 


^(T)  •  0 


{' 


.  > 


Set  x(T)  -  u.  For  u  >  0«  d  ^/dt  <  0  «t  t  ■  T,  hnA  h«Aot 

t 

^  >  0  in  ioae  interval  tj  ^  t  <  T.  1h*n  ■  >  0,  I  <  0  on 
and  50  y(t,u)  •  1,  z(t,u)  -  1  and  dx(t,u)/dt  •  */§  along  tho 
extremal  patting  through  (u,T).  Along  thit  extreatl^  x(t,u)  « 
(t-T)/2  >  u.  The  value  of  ti  it  detenclned  by  A(ti)  *0  to  be 
tj-T«--Au.  Att-ti,*re  have  x(ti,u)  -  ~  u.  SUaiigrlj. 


tV' 


-  {:* 


>  f 


for  u  <  0,  we  have  y(t,u)  -  0,  i(t,u)  •  0  on  an  Interval  ^  t 
along  this  extremal,  we  have  x(t,u)  •  -(t  -  T)  ♦  u,  the  value  ef 
ta  it  ta  -  T  •  2u,  and  x(ta,u)  «  -  u.  We  have  thua  defined  twe 
one— parameter  faniliea  of  extremals,  one  fanily  correeponding  to 
values  u  >  0,  and  the  other  to  values  u  <  0.  Consider  the  flivt  . 

• 

family  on  the  closed  region  Ci  defined  by  u  ^  0,  T  -  (>u/2)  ^  t 
and  the  second  family  on  the  region  defined  by  u  ^  0,  T  ^  % 

<  t  <  T.  (See  fig.  2.)  The  function  x(t,u)  •  (t-T)/i  •f  u  nbpW  ^ 

•  e 

the  interior  of  Ui  in  a  one— to-orve  faahion  onto  the  region  Hi 

of  the  (x,t)  plane  defijied  by  t  <  T  and  x  >  -  (t-T)/i.  (See 

Fig.  2b.)  On  the  otlier  hand,  the  function  x(t,u)  ■  ^ 

•  • 

naps  the  Interior  of  U*  onto  the  region  ll«  which  it  defined  bf 
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t  <  T  and  X  <  -  (t— T)/6.  Denoting  functions  fro«  the  first 
faally  by  the  subscript  1  and  those  fron  the  second  by  2,  we 
have*  for  arbltrarr  t^  ^  T, 

and 

T  ''  T 

-  ~  VsCVT))*  dt  -  ((t-T)  ♦  Va(t^-T)}*  dt] 

^o 

that  Is, 

-  ■/s(to“T))  -  w.(t^,  Ve(to^))  . 

Thus  we  have  a  field  over  the  half  plane  t  T  with  two  subregions 

•  • 

Ri  and  R« .  To  place  the  exaaple  completely  In  the  context  of  the 

•  • 

theory  we  restrict  Ut  and  Qa  to  nonnegative  t  values  and  bounded 
a  values  In  order  to  obtain  regions  U|  eind  Us,  respectively, 

and  thereby  obtain  In  tux*n  regions  and  Ra  which  are  restrlc— 

#  • 

tlons  of  Ri  and  R«,  respectively,  and  lie  In  the  strip  0  <  t  <  T 
of  the  (x,t)  plane.  A  saddle-point  Is  the  pair  of  functions: 


1 

If 

(x»t) 

Is 

In 

Ri  or 

In  R|  A 

Re  a 

y(x. 

t) 

i  0 

If 

(X,t) 

Is 

In 

Rs: 

'  1 

If 

(x.t) 

Is 

In 

Rt  or 

In  RiA 

Re  * 

z*(x. 

t) 

■  ^ 

0 

If 

(X,t) 

is 

In 

Re  . 

. .  .  \  i 
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